Cross-GCN: Enhancing Graph Convolutional Network with k-Order Feature Interactions
نویسندگان
چکیده
Graph Convolutional Network (GCN) is an emerging technique that performs learning and reasoning on graph data. It operates feature the structure, through aggregating features of neighbor nodes to obtain embedding each target node. Owing strong representation power, recent research shows GCN achieves state-of-the-art performance several tasks such as recommendation linked document classification. Despite its effectiveness, we argue existing designs forgo modeling cross features, making less effective for or data where are important. Although neural network can approximate any continuous function, including multiplication operator crosses, it be rather inefficient do so (i.e., wasting many parameters at risk overfitting) if there no explicit design. To this end, design a new named Cross-feature Convolution, which explicitly models arbitrary-order with complexity linear dimension order size. We term our proposed architecture Cross-GCN, conduct experiments three graphs validate effectiveness. Extensive analysis validates utility in GCN, especially lower layers.
منابع مشابه
Graph Based Convolutional Neural Network
In this paper we present a method for the application of Convolutional Neural Network (CNN) operators for use in domains which exhibit irregular spatial geometry by use of the spectral domain of a graph Laplacian, Figure 1. This allows learning of localized features in irregular domains by defining neighborhood relationships as edge weights between vertices in graph G. By formulating the domain...
متن کاملTensor graph convolutional neural network
In this paper, we propose a novel tensor graph convolutional neural network (TGCNN) to conduct convolution on factorizable graphs, for which here two types of problems are focused, one is sequential dynamic graphs and the other is cross-attribute graphs. Especially, we propose a graph preserving layer to memorize salient nodes of those factorized subgraphs, i.e. cross graph convolution and grap...
متن کاملModeling Text with Graph Convolutional Network for Cross-Modal Information Retrieval
Cross-modal information retrieval aims to find heterogeneous data of various modalities from a given query of one modality. The main challenge is to map different modalities into a common semantic space, in which distance between concepts in different modalities can be well modeled. For crossmodal information retrieval between images and texts, existing work mostly uses off-the-shelf Convolutio...
متن کاملProbabilistic Graph-based Dependency Parsing with Convolutional Neural Network
This paper presents neural probabilistic parsing models which explore up to thirdorder graph-based parsing with maximum likelihood training criteria. Two neural network extensions are exploited for performance improvement. Firstly, a convolutional layer that absorbs the influences of all words in a sentence is used so that sentence-level information can be effectively captured. Secondly, a line...
متن کاملLearning Graph While Training: An Evolving Graph Convolutional Neural Network
Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they are highly diverse or even not well defined. Under some circumstances, e.g. chemical molecular data, clustering or coarsening for simplifying the graphs is h...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering
سال: 2021
ISSN: ['1558-2191', '1041-4347', '2326-3865']
DOI: https://doi.org/10.1109/tkde.2021.3077524